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We present a detailed analysis of the convergence properties of Lyapunov control for finite- 
dimensional quantum systems based on the application of the LaSalle invariance principle and 
stability analysis from dynamical systems and control theory. Under an ideal choice of the Hamil- 
tonian, convergence results are derived, with a further discussion of the effectiveness of the method 
when the ideal condition of the Hamiltonian is relaxed. 



I. INTRODUCTION 

Control theory has developed into a very broad and 
interdisciplinary subject. One of its major concerns is 
how to design the dynamics of a given system to steer it 
to a desired target state, and how to stabilize the system 
in a desired state. Assuming that the evolution of the 
controlled system is described by a differential equation, 
many control methods have been proposed, including op- 
timal control [TJ geometric control [3] and feedback 
control [4]. 

Quantum control theory is about the application of 
classical and modern control theory to quantum systems. 
The effective combination of control theory and quantum 
mechanics is not trivial for several reasons. For classical 
control, feedback is a key factor in the control design, 
and there has been a strong emphasis on robust control 
of linear control systems. Quantum control systems, on 
the other hand, cannot usually be modelled as linear con- 
trol systems, except when both the system and the con- 
troller are quantum systems and their interaction is fully 
coherent or quantum-mechanical [5 . This is not the case 
for most applications, where we usually desire to control 
the dynamics of a quantum system through the interac- 
tion with fields produced by what are effectively classical 
actuators, whether these be control electrodes or laser 
pulse shaping equipment. Moreover, feedback control for 
quantum systems is a nontrivial problem as feedback re- 
quires measurements, and any observation of a quantum 
system generally disturbs its state, and often results in 
a loss of quantum coherence that can reduce the system 
to mostly classical behavior. Finally, even if measure- 
ment backaction can be mitigated, quantum phenomena 
often take place on sub-nanosecond (in many case femto- 
or attosecond) timescales and thus require ultrafast con- 
trol, making real-time feedback unrealistic at present. 
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This is not to say that measurement-based quantum 
feedback control is unrealistic. There are various inter- 
esting applications, e.g., in the area of laser cooling of 
atomic motion [B], or for deterministic quantum state re- 
duction [7] and stabilization of quantum states, to men- 
tion only a few, and progress in technology will undoubt- 
edly lead to new applications. Nonetheless, there are 
many applications of open-loop Hamiltonian engineer- 
ing in diverse areas from quantum chemistry to quan- 
tum information processing. Even in the area of open- 
loop control many control design strategies, both geom- 
etry [5J IHJ Unj EE] and optimization-based |T21 IB] H3], 
utilize some form of model-based feedback. A particular 
example is Lyapunov control, where a Lyapunov func- 
tion is defined and feedback from a model is used to 
generate controls to minimize its value. Although there 
have been several papers discussing the application of 
Lyapunov control to quantum systems, the question of 
when, i.e., for which systems and objectives, the method 
is effective and when it is not, has not been answered 
satisfactorily. 

Several early papers on Lyapunov control for quan- 
tum systems such as jTSJ [TBI CL7] considered only control 
of pure-state systems, and target states that are eigen- 
states of the free Hamiltonian H , and therefore fixed 
points of the dynamical system. For target states that are 
not eigenstates of Hq, i.e., evolve with time, the control 
problem can be reformulated either in terms of asymp- 
totic convergence of the system's actual trajectory to that 
of the time-dependent target state, or as convergence to 
the orbit of the target state (or more precisely its clo- 
sure). Such cases have been discussed in several papers 
HE1 EES EU HI! H2] but except for [UJ [22], the problem 
was formulated using the Schrodinger equation and state 
vectors that can only represent a pure state. To give a 
complete discussion of Lyapunov control, it is desirable 
to utilize the density operator description as it is suitable 
for both mixed-state and pure-state systems, and can be 
generalized to open quantum systems subject to environ- 
mental decoherence or measurements, including feedback 
control. In [5TJ [22] Lyapunov control for mixed-state 
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quantum systems was considered but the notion of orbit 
convergence used is rather weak compared to trajectory 
convergence, the LaSalle invariant set was only shown to 
contain certain critical points but not fully characterized, 
and a stability analysis of the critical points was missing, 
in addition to other issues such as the assumption of peri- 
odicity of orbits, etc. Furthermore, while an attempt was 
made to establish sufficient conditions to guarantee con- 
vergence to a target orbit, the effectiveness of the method 
for realistic system was not considered. 

In this paper we address these issues. We consider the 
problem of steering a quantum system to a target state 
using Lyapunov feedback as a trajectory tracking prob- 
lem for a bilinear Hamiltonian control system defined on 
a complex manifold, where the trajectory of the target 
state is generally non-periodic, and analyze the effective- 
ness of the Lyapunov method as a function of the form 
of the Hamiltonian and the initial value of the target 
state. In Sec. [IT] the control problem and the Lyapunov 
function are defined, and some basic issues such as dif- 
ferent notions of convergence and reachability of target 
states are briefly discussed. In Sec. |III| the controlled 
quantum dynamics is formulated as an autonomous dy- 
namical system defined on an extended state space, and 
LaSalle 's invariance principle [23] is applied to obtain a 
characterization of the LaSalle invariant set. This char- 
acterization shows that even for ideal systems satisfying 
the strongest possible conditions on the Hamiltonian, the 
invariant set is generally large, and the invariance prin- 
ciple alone is therefore not sufficient to conclude asymp- 
totic stability of the target state. Noting that the invari- 
ant set must contain the critical points of the Lyapunov 
function we characterize the former in Sec. IIVI In Sec. IVl 
we give a detailed analysis of the convergence behaviour 
of the Lyapunov method for finite-dimensional quantum 
systems under an ideal control Hamiltonian based on the 
characterization of the LaSalle invariant set and our sta- 
bility analysis. The discussion is divided into three parts, 
control of pseudo-pure states, generic mixed states, and 
other mixed states. The result is for this ideal choice of 
Hamiltonian Lyapunov control is effective for most (but 
not all) target states. Finally, in Sec. VI we relax the 



unrealistic requirements on the Hamiltonian imposed in 
Sec. |Vj and show that this leads to a much larger LaSalle 
invariant set, and significantly diminished effectiveness of 
Lyapunov control. 



II. STATE AND TRAJECTORY TRACKING 
PROBLEM FOR QUANTUM SYSTEMS 

A. Quantum states and evolution 

According to the basic principles of quantum mechan- 
ics the state of an n-level quantum system can be repre- 
sented by an n x n positive hermitian operator with unit 
trace, called a density operator p, and its evolution is 



determined by the Liouville von- Neumann equation [24. 

p{t) = -ih[H,p{t% 

where H is the system Hamiltonian, denoted by an n x n 
Hermitian operator. If we are considering a sub-system 
that is not closed, i.e., interacts with an external environ- 
ment, additional terms are required to account for dissi- 
pative effects, although in principle, we can always con- 
sider the Hamiltonian dynamics on an enlarged Hilbcrt 
space, and we shall restrict our discussion here to Hamil- 
tonian systems. We shall say a density operator p rep- 
resents a pure state if it is a rank-one projector, and 
a mixed state otherwise. We further define the special 
class of pseudo-pure states, i.e., density operators with 
two eigenvalues, one of which occurs with multiplicity 
1, the other with multiplicity n — 1, and generic mixed 
states, i.e., density operators with n distinct eigenvalues. 



B. Control Problem 

In the following we consider the bilinear Hamiltonian 
control system 



p(t) = -i[H + f(t)H l ,p(t)}, 



(1) 



where f(t) is an admissible real-valued control field and 
Hq and H\ are a free evolution and control interaction 
Hamiltonian, respectively, both of which will be assumed 
to be time- independent. We have chosen units such that 
the Planck constant h = 1 and can be omitted for conve- 
nience. 

The general control problem is to design a certain con- 
trol function f(t) such that the system state p(t) with 
p(0) = po will converge to the target state pd- Since the 
evolution of a Hamiltonian system is unitary, the spec- 
trum of p(t) is therefore time-invariant, or equivalently 



Tr[p n (t)]=Tr[p%], Vn e IN. 



(2) 



Hence, for the target state pd to be reachable, po and 
Pd must have the same spectrum, or entropy in physical 
terms. If po and pd do not have the same spectrum, 
we can still attempt to minimize the distance \\p(t) — 
Pd(t)\\, but it will always be non-zero if we are restricted 
to Hamiltonian engineering. For the following analysis we 
shall assume that the initial and the target state of the 
system have the same spectrum. If this is the case and 
the system is density-matrix controllable, or pure-state 
controllable if the initial state of the system is pure or 
pseudo-pure, then we can conclude that the target state is 
reachable, although a particular target state may clearly 
be reachable even if the system is not controllable [25] . 

Assuming that po and pd have the same spectrum, the 
quantum control problem can be characterized by the 
spectrum of the target state. If pd is pure, the problem is 
called a pure-state control problem. Analogously, we can 
define the pseuo-pure-state control and generic-state con- 
trol. Pure-state control problems are often represented 
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in terms of Hilbert space vectors or wavefunctions 
evolving according to the Schrodinger equation 

j t \m) = -i{H a + f{t)H 1 )\m)- (3) 

For pure states this wavefunction descritpion is equiva- 
lent to the density operator description since any rank- 
one projector p can be written as p = IfAKV'l f° r some 
Hilbert space vector but it docs not generalize to 
mixed states, and we shall not use this formalism here. 

Since the free Hamiltonian Hq can usually not be 
turned off, it is natural to consider non-stationary tar- 
get states pd evolving according to 

p d {t)=-i[H 0>Pd (t)]. (4) 

It is easy to see that pd is stationary if and only if it 
commutes with Ho, [Ho,p d (0)} = 0. Thus the problem 
of quantum state control for most target states is more 
akin to a trajectory tracking problem, where the objec- 
tive generally is to find a control f(t) such that the tra- 
jectory p(t) of the initial state po under the controlled 
evolution asymptotically converges to a target trajectory 
Pd{t). 

C. Trajectory vs Orbit Tracking 

It has been argued that the problem of quantum state 
control should instead be viewed as an orbit tracking 
problem [22] , i.e., the problem of steering the trajec- 
tory p(t) towards the orbit of the target state p d - How- 
ever, one problem with this approach is that the notion 
of orbit tracking is relatively weak as the orbit of a quan- 
tum state, or more precisely its closure, under free evolu- 
tion can be rather large, and there are generally infinitely 
many distinct quantum states whose orbits under free 
evolution coincide. For example, even for two- level sys- 
tem evolving under the free Hamiltonian Hq — diag(0, uS) 
the trajectories of the pure states |\£±) = ^(|0) ± |1)) 
are orthogonal, and thus perfectly distinguishable, for all 
times t, |*±(t)) = 4|(|0) ± e iut \l)), but their orbits are 

the same, = {*(t) : *(0) = t > 0} = 

For the two-level example above, the orbits are always 
periodic and thus closed, and we can at least say that if 
the quantums state p(t) converges to the periodic orbit 
O(pd) of p d , then for every state p a & 0{pd) there exists 
a sequence of times {tk} such that \\p(tk) — Poll — * ^ 
k — > oo, but this notion of convergence is much weaker 
than the notion of trajectory convergence, which requires 
\\p(t) — Pd(t)\\ — > as t — > oo, and we shall see that there 
are cases where it is possible to track the orbit but not a 
particular trajectory. The notion of orbit tracking is even 
more problematic for non-periodic orbits, which comprise 
the vast majority of orbits for systems of Hilbert dimen- 
sion n > 2, except for the measure-zero set of Hamil- 
tonians H with commensurate energy levels, i.e., with 
transition frequencies that are rational multiples of each 



other. Of course, we can still ask the question whether 
the state of the system converges to the closure of the 
orbit of a target state, but the dimension of this orbit set 
is generally very large. For instance, the state manifold 
of pure states for an n-dimcnsional system has (real) di- 
mension 2n~ 2, while the closure of the orbit of any state 
under a generic Hamiltonian H has dimension n — 1 . 

For these reasons, we shall concentrate on quantum 
state control in the sense of trajectory tracking as this is 
the strongest notion of convergence and well-defined for 
arbitrary trajectories. 

D. Control Design based on Lyapunov Function 

A natural design of f(t) is inspired from the concep- 
tion of Lyapunov function, which is a very important 
tool in stability analysis for dynamical systems. For an 
autonomous dynamical system x — f(x), a differentiablc 
scalar function V(x), defined on the phase space = {x}, 
is called a Lyapunov function, if: 

(i) V(x) is continuous and its partial derivatives are 
also continuous on f2; 

(ii) V(x) is positive definite, i.e., V(x) > with equal- 
ity only at x = x ; 

(iii) for any dynamical flow 4>t{x), V{(f>t(x)) = 
V{x(t)) < 0. 

With the conditions above, it can be shown that x = xq is 
Lyapunov stable; if equality in (iii) holds only for x = xq, 
we can further conclude that x — Xq is asymptotically 
stable. However, in general, we can only guarantee V < 
0, and in this case, we can only use a weaker result known 
as the LaSalle invariance principle [23] , which claims that 
any bounded solution will converge to an invariant set, 
called the LaSalle invariant set. 

Let M to be the set of density operators isospec- 
tral with P d(0) and consider the joint dynamics for 
(p(t),p d (t)) on MxM: 

p{t) = -i[Ho + f{t)Hi,p{t% (5a) 
Pd(t) = -i[H ,p d (t)}. (5b) 

The Hilbert-Schmidt norm ||A|| = y/Tr(A^A) induces a 
natural distance function on xM, which provides a 
natural candidate for a Lyapunov function 

V{p,p d ) = \\\p-p d \\ 2 =\^[{p-p d ) 2 ]. (6) 

If p and p d are isospectral, this definition is equivalent to 

V(p, Pd ) = Tr[p 2 d (t)} - Tv[p{t) Pd {t% (7) 

the Lyapunov function used in [21] [22]. If pd = \ipd)(ipd\ 
and p = \ij>) {ip | we have furthermore 

v(i>,ip d ) = i-\{Mt)m))\ 2 , (8) 
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a Lyapunov function often used for pure-state control. 

To see that Eq. Q defines indeed a Lyapunov function, 
note that V > with equality only if p = p d , and 

V = - Tr(p d p) - Tr(pdp) 

= - Tr(H#o, Pd]p) - Tt(p d [-iH 0> p]) 

-f(t)Tr(p d [-iH u p}) 
= -f(t)Tr(p d [-iH 1 ,p]), 

where we have used 

Tr([-iH 0) Pd]p) = - Tr(p d [-iH , p]) 

and Tr(p^) = 0. If we choose the control field as 



f(p,Pd) = KTi(p d [-iHx,p\), k>0, 



(9) 



then V(p(t), Pd(t)) < 0. Without loss of generality, we 
set k — 1 in the following. 

Hence, the evolution of the system {p,p d ) with Lya- 
punov feedback is described by the following nonlinear 
autonomous dynamical system on M. x M.: 

p{t) = -i[H Q + f{p,p d )H u p{t% (10a) 

p d {t) = -i[H ,p d (t)], (10b) 
f(p,p d ) = Tr([-iH 1 ,p]p d ). (10c) 

The manifold A4 here is a homogeneous space known as a 
flag manifold, whose dimension and topology depend on 
the spectrum, or more precisely, the number of distinct 
eigenvalues, of the density operators p, p d , under con- 
sideration. For pure or pseudo-pure initial states po, for 
example, M. is homeomorphic to the complex projective 
space CP™ -1 , while for a generic mixed state, we obtain 
the n 2 — n dimensional manifold U(n)/ ®" =1 U(l). By 
simply comparing the dimensions, we see that in the spe- 
cial case n = 2 (and only 2) the generic mixed states and 
pseudo-pure states have the same dimension, and one can 
easily show that in this case all mixed states (except the 
completely mixed state) are pseudo-pure, a fact that will 
be relevant later. 



III. LASALLE INVARIANCE PRINCIPLE AND 
LASALLE INVARIANT SET 

A. Invariance Principle for Autonomous Systems 

For an autonomous dynamical system with x = f(x), 
we say a set is invariant, if any flow starting at a point in 
the set will stay in it for all times. For any solution x(t) 
we define the positive limiting set T + to be the set of all 
limit points of x(t) as t — > +oo. First of all, we have the 
following two lemmas: 

Lemma III.l. For x = f(x) defined on a finite- 
dimensional manifold, the positive limiting set T + of any 
bounded solution x(t) is an non-empty, connected, com- 
pact, invariant set. 



The proof can be found in [25] (Sec. 3.2, Theorem 2). 

Lemma III. 2. Any bounded solution x(t) will tend to 
any set containing its positive limiting set T + as t — > oo. 

Proof. Suppose x (t) does not converge to T + . Then there 
exists some e > 0, and a sequence t n such that x(t n ) is 
outside the e-neighborhood of T + . But x(t n ) is a bounded 
set, so it has a subsequence that converges to a point xq. 
By assumption xq T + , which contradicts the definition 
of the positive limiting set. Hence, xq must belong to the 
positive limiting set. □ 

From these results we can derive the LaSalle invariance 
principle [23 : 

Theorem III.l. For an autonomous dynamical sys- 
tem, x — f{x), let V(x) be a Lyapunov function on 
the phase space = {x}, satisfying V(x) > for all 
x 7^ xq and V{x) < 0, and let 0(x(t)) be the or- 
bit of x(t) in the phase space. Then the invariant set 
E = {0{x{t))\V (x(t)) — 0} contains the positive limiting 
sets of all bounded solutions, i.e., any bounded solution 
converges to E as t — > +oo. 

Proof. Since V(x(t)) is monotonically decreasing due to 
V < 0, V(x(t)) has a limit Vq > as t — > +oo for any 
bounded solution x(t) . Let T + be the positive limiting set 
of x(t). By continuity, the value of V on T + must be Vq. 
Since T + is an invariant set, we can take the time d eriva- 
tive of V to conclude V = on T + . By Lemma 
x(t) will converge to T + , and hence to E. 
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□ 



Remark III.l. From the proof above, we can see that 
the theorem holds for both real and complex dynamical 
systems. Broadly speaking, what has been proved is that 
bounded solutions with V{x) ^ will converge to the set 
of solutions with V(x) = 0. Therefore, it does not matter 
if V has many points x with V(x) — 0. For example, 
for the quantum system (10), the Lyapunov function V 



is zero on all points (p d , pdj 



The quantum system (|10j) is autonomous and defined 
on the phase space M. x M., where Ai is a compact 
finite dimensional manifold. Therefore, any solution 
(p(t),p d (t)) is bounded. Although the Lyapunov func- 
tion ([7]) is not positive definite, we have V — if and 
only if p — p d , which is sufficient to apply the LaSalle 
invariance principle |III.l| to obtain: 

Theorem III. 2. Any system evolution (p(t),p d (t)) un- 
der the Lyapunov control ^ will converge to the in- 
variant set E = {(pi,p2) G M x M\V(p(t),p d (t)) = 
0,(p(0),p d (0)) = ( Pl ,p 2 )}. 

We note here that except when p d is a stationary state, 
we must consider the dynamical system on the extended 
phase space M x M as V is not well-defined on M. 
Having established convergence to the LaSalle invariant 
set E, the next step is to characterize E for the dynamical 



system (10) 
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B. Characterization of the LaSalle Invariant Set 

LaSalle's invariance principle reduces the conver- 
gence analysis to calculating the invariant set E — 
{V(p(t), pd(t)) — 0}, which is equivalent to f(t) = 0, 
for any t. Therefore, we have 

= f = Tr([-iH 1 ,p]p d ) 
= / = Tr([-iH liP ]p d ) + Tr{[-iH llP ]p d ) 
-Tr([[-iH Q ,-iH 1 },p]p d ) 







dt e 



= (-l) n Tr([AdU Ho (-iHx),p)p d ), 



where Ad_ iHo (—iHi) represents €-fold commutator ad- 
joint action of — iH on —iHx- Hence, Tr([A,B]C) = 
-Tr([C,B]A) = -Tr([A,C]B) gives a necessary condi- 
tion for the invariant set E: 

Tr([p,p d ]Ad™ Ho (-iH 1 ))=0, VrneMo, (11) 

where Ad_ iHo (— iHx) = —iH\. Since Hq is Hermitian we 
can choose a basis such that Hq is diagonal 



Hq = 



/ai 
a 2 







diag(ai, . . . ,a n ) 



\0 ... a n J 



with real eigenvalues a k , which we may assume to be 
arranged so that > dk+i for all k. Let {b k t) be the 
matrix representation of Hi in the eigenbasis of Hq, and 
u>ke = a,£ — a k be the transition frequency between energy 
levels k and £ of the system. 

The Lie algebra su(n) can be decomposed into 
an abelian part called the Cartan subalgebra C = 
span{Afc}j!~J, and an orthogonal subalgebra T, which is 
a direct sum of n(n — l)/2 root spaces spanned by pairs 
of generators {\ k t, \ki\- For instance, we can choose the 
generators 



Afc — i{<ikk — e/c+i,fc+i) 
X k £ = i{e.kt + eek) 
X k t = (e.ki — etk) 



(12a) 
(12b) 
(12c) 



for 1 < k < I < n, where the (k,£) th entry of the elemen- 
tary matrix e mn equals Skm^in- Expanding —iHx G su(n) 
with respect to these generators 



ra-1 

fc=i 



6fcA fe + 



n 

E 

t=k+l 



(13) 



and noting that we have for D = Y^k=i dk&kk 

[D,X h ]=0, (14a) 

[D,\kt]=+i(.d k -d e )\kt, (14b) 

[D, X M ] = -i(d k - d e )X M , (14c) 



shows that B m = Ad™ iH (— iHi) is equal to 

n — 1 n 

B 2m -i = £ ^-^iT^M^hi + Z(b M )\ ke ], 

k=l £=k+l 

(15a) 

n—1 n 

#2m=£ £ (-l) m ^[»(MA H -3(yA M ]. 



(15b) 



Let£? s = span{f? m }^ =1 and Bq — span{B m }^ =0 with 
B = —iHx. Then Eq ( fTT| is equivalent to [p, p d ] be- 
ing orthogonal to the subspace Bq with respect to the 
Hilbcrt-Schmidt norm. 

2 

Theorem III. 3. The subspace B n ™ generated by the 
Ad-brackets is a subset of the Cartan subalgebra T of 
5u(n) with equality if 

(i) Hq is strongly regular, i.e., io k i ^ Lo pq unless 
(k,£) = (p,q). 

(ii) H\ is fully connected, i.e., b k i ^ except (possibly) 
for k — £. 

Proof. Since the dimension of T is n 2 — n and B m G T 
for all m > 0, it suffices to show that the elements B m 
for m = 1, . . . , n 2 — n are linearly independent. More- 
over, the subspaces spanned by the odd and even order 
elements, B^ dd = span{£? 2m -i : 1 < 2m — 1 < s} and 
£>cven = span{£?2m : 1 < 2m < s}, respectively, are or- 
thogonal since 



r> r> / i \ m+m' \ " \ , 2m-l 2m' 

B 2m -lB 2m > - (-ij 2^ 2^ ^ x 

fc',£' 

[$t(b k e)$l(b k >e<)X M X k > e ~ 3(6^)3(6^) A^A^/ 
- %t(b k t)$(b k >i>)\ia\ k >t> + Ss(b k t)$l(b k >e>)X k e\ k >e'], 
and thus observing the equalities 

Tr(AMAfc'r) = Tr(Afc^Afe/^) = -25 kk i5w (16a) 
Tr(\ ki \ kli ,) = (16b) 

shows that for all m.m' > 



Tv(B 2m _iB 2m ,) = (-1)™+™' £ £ , 



2m-l 2m' 
'kl W k'V X 



feJ fe',£' 



5?(MS(M[-A^ + A 2 f ] = 0. 



odd 



Thus it suffices to show that the elements of B t 

2 

S™ vo ~™ are linearly independent separately. 

For the odd terms, suppose there exists a vector 
c = (ci,...,c s ) T of length s = n(n — l)/2 such that 
El = i c m B 2m ^i = 0. Noting that uj k k = and (^ fe ) 2 = 
(— oj/c^) 2 this gives n(n — l)/2 non-trivial equations 



[5i(MA^ + 9f(6w)Afc/] ^ (-w^)" 1 - 1 ^ = 0, (17) 
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for 1 < k < I < n. Since oj^i ^ 0, bu ^ by hypothesis, 
Eq. (17 1 can be reduced to f2c = 0, where fl is a matrix: 



/l 



-12 



-12 
4 



(-w? 3 ) 



l -ui 



(18) 



V n— l,n/ / 



Since f2 is a Vandermonde matrix, condition (ii) of the 
proposition guarantees that Eq. ( 17 1 has only the trivial 
solution c = 0, thus establishing linear independence. For 
the even terms we obtain a similar system of equations, 
which completes the proof. □ 

If B n ~ n — T then any point (pi, p 2 ) in the invariant 
set E must satisfy [pi,p 2 ] = diag(ci, . . . , c n ). Further- 
more, Tr(— iHi [pi, p 2 ]) = yields in addition 



i ^2 hecik 

k.l=l 



(19) 



it=i 



However, in many applications the energy level shifts in- 
duced by the field are negligible, and we can assume the 
diagonal elements of Hi to be zero. With this additional 
assumption we have Bq C T, and thus the maximum di- 
mension of Bq is n? — n, and we have the following useful 
result. 

Theorem III. 4. Under conditions (i) and (ii) of The- 
orem 

) Cn) 



III. 3 (pi,p2) belongs to the invariant set E if and 
only if [pi ,p 2 ] = diag(c 1; . 



Proof. We have proved the necessary part. For the sufir- 

e~ lHot p k e iHot , k = 1,2, 



cient part note that Pk(t) = e %Hot Ph.e lHot , k 



r —tHnt iHnt —iHnt iHntl 

[e p\e , e p 2 e \ 



^—iHntr i iHnt 

e [pi,p2\e 



and e ot diagonal. Thus if [pi,p 2 ] — diag(ci, 
then e~ jHot [pi,p 2 ]e iH °* = diag(ci, 
hence (pi,p 2 ) S E. 



i C n ) 



• , Cn) = [pi,Pa] and 
□ 



Thus we have fully characterized the invariant set for 
systems with strongly regularly H and an interaction 
Hamiltonian H± with a fully connected transition graph. 
The result also shows that even under the most stringent 
assumptions about the system Hamiltonians, the invari- 
ant set is generally much larger than the desired solution. 
Therefore, the invariance principle alone is not sufficient 
to establish convergence to the target state. 



IV. CRITICAL POINTS OF THE LYAPUNOV 
FUNCTION 

In this section we show that invariant set E always con- 
tains at least the critical points of the Lyapunov function 
V and classify the stability of the critical points. We start 
with the case where p c i is a fixed stationary state. In this 



case the Lyapunov function V (p, pd) is effectively a func- 
tion V(p) on M.. Since p can be written as p = UpdU' 
for some U in the special unitary group Sit(n) , V also be 
considered a function on &ii(n), V(U) = V(U pdU^ pd)- 
It is easy to see that the critical points of V(p) correspond 
to those of V(U), and since Tr[p c ;(i)] 2 = C is constant, 
it is equivalent to find the critical points of J(U): 



J{U) = C-V{U) 

= Tr(U Pd U^p d ), Ueeil{n) 



(20) 



Le mm a IV. 1. The critical points Uq of J(U) defined 



by (20) are such that [po,pd] = for po — UopdU^. 



Proof. Let {<J m }l n= i be an orthonormal basis for the 
Lie algebra su(n), consisting of n 2 — n orthonormal off- 



diagonal generators such as 



H-e, 



V2 



ki Wl 



th Xhf . A 



k£, *kl 



as in Eq. (|12|, and n— 1 orthonormal diagonal generators 

- re r+ i,r+i (21) 



<J n 2_ 



■n+r 



1) 



for r = I, ... ,n — I. Set a = (<xi, . . . , cr„2_ 1 ). Any U <E 
6il(7i ) near the identity / can be written as U = e x ' CT , 
where x € IR™ is the coordinate of U, and any U in the 
neighborhood of Uq can be parameterized as U = e x ' CT Uo. 



Thus Eq. (20) becomes 

J = Tr[{e s - 3 U )pd{Ule- 3 - 3 )p d \. (22) 
At the critical point Uq, V J = implies that for all m 
dJ 







dx r , 



Ti(o- m Uop d U^Pd - U p d U^a m pd) 

Tr[a m (Uop d U^pd - PdU Q pdU^)} 
Tr(a m [Uop d U^,pd\). 



(23) 



Thus [UopdUQ , pd] £ su(n) is orthogonal to all basis ele- 
ments er m , and therefore [UopdUo, Pd] — 0- d 

Hence, for a given p d , the critical points of V(p) are 
such that [p, pd] — 0, i.e., p and p d are simultaneously 
diagonalizable. Let {u>i, . . . , w n } be the spectrum of pd 
with Wk arranged in a non-increasing order. For any 
critical point po there thus exists a basis such that 



diag(u>i, . . 
diag(w r(1) , 



, w n ), 

■ ■ ) U>r(n))i 



for some permutation r of the numbers {1, . 
the corresponding critical value of V is 



V(Po,Pd) 



E 

fe=i 



Wk(w k - ^r(fc))- 



. , n}, and 



(24) 



More generally, for V(pi,p 2 ) defined on M. X M., there 
exists E/i and U 2 such that 



p 1 = U 1 p d U{, p2 = U 2 pdU. 



7 



Since Tr(p?,) is constant, the critical points of V are again 
the critical points of J(p\,p2) = Tr(pip2) and 

J(I7i, C/ 2 ) = Tr (u lPd UlU iPd vty 

= Tv([UlU 1 ) Pd {UlU 1 )^p^ 

together with Lemma [I V . 1 1 shows that J attains its crit- 
ical value when [(f/J U\)p d (Ul U\)\ pd] = 0, and thus 

Q = u 2 [{ulu 1 ) Pd {ulu l )\ Pd ]ul 
= [u lPd u\,u 2 p d ul] = [ Pl , P2 \. 

Thus we have the following: 

Theorem IV. 1. For a given Pd , the critical points of 
the Lyapunov function V(p\,p2) on M x M are such 
that {[p\,p2\ = 0}. Therefore, the LaSalle invariant set 
contains all the critical points of V(px, fe)- 

Next, we show that for a generic stationary state Pd , 
J(p) = Tr(pp d ), and thus V(p) = V(p,p d ), is a Morse 
function [27] on Ai, i.e., its critical points are hyperbolic: 

Theorem IV. 2. // p d has non- degenerate eigenvalues 
then J(p) is a Morse function on M.. Moreover, all but 
two critical points corresponding to the global maximum 
and minimum of J, respectively, are saddle points with 
critical values Jo satisfying J nim < Jq < J max - 

Proof. For non-degenerate p dl we choose a basis such 
that p d — diag(u>i, . . . , w n ) with Wk arranged in decreas- 
ing order. Then there are n! critical points satisfying 
po = diag(t« T ( 1 ), . . . , w r („)), for some permutation r, cor- 
responding to the critical value J{po) — J2k=i w k w T(k)- 
Again, we consider J = Tr (pp d ) = Tr (Up d W p d ) as a 
function on 6il(n). Let Uo correspond to the critical 
point po. As in the proof of Theorem |IV.1| any U in 
the neighborhood of Uo can again be parameterized as 
U = e x ' a Uo- Substituting this into J, we obtain: 

J = Tr[e s - B U p d ule- 3 - s p d ] 
= Tr[(/ + z -a+^x-df) x U oPd U^x 

(I-x'-a+~(x-a) 2 ) Pd ]+G(\x\ 3 ) 

= Tr[Uo Pd Ulp d ] + l - Tr[{x ■ a) 2 U aPd Ulp d ] 

+ \Tr[U p d Ul{x-a) 2 p d ] 

- Tr[{x ■ d)Uop d Ul{x-cr)p d ] + e(\x\ 3 ) 

Choosing a curve in Sil(n) passing through Uq such 
that x ■ a — Xklf, we have 

J = Tx[Uo Pd ul Pd }+t 2 {Tx{\uUo Pd Ul\\ tPd ) 
-Tr(U oPd ul Pd )} + e(\t\ 3 ). 



Analogously, choosing a curve in SU(n) passing through 
Uq such that x* ■ a = Xket, we have 

J = Tr[U QPd ulp d ]+t 2 {Tr(heU p d ulxl iPd ) 
-Tr(U p d Ulp d )} + e(\t\ 3 ). 

The conjugate action of Xke or Xki on the critical point 
Po = Uop d Ug swaps the fc-th and £-th diagonal elements. 
Since p d is non-degenerate, any swap Afe^ or Xke will ci- 
ther increase or decrease the value of J = 53fc=i w kW T (k), 
corresponding to a minimum or maximum along that di- 
rection. This holds for all directions of Xke and Xke, and 
since the dimensions of T and M. are both n 2 — n, we 
have found n 2 — n independent directions along which J 
corresponds to a maximum or minimum. Thus these n\ 
critical points are all hyperbolic. The maximal critical 
value occurs only when po = p d and the minimal value 
occurs only when w t (ja 's are in an increasing order. For 
all other critical values, there always exists a swap that 
will increase the value of J and a swap that will decrease 
it, showing that they are saddle points of the J. □ 



V. LYAPUNOV CONTROL UNDER AN IDEAL 
HAMILTONIAN 

In this section we consider the implications of the re- 
sults of the previous sections on the convergence be- 
haviour and effectiveness of Lyapunov control of a quan- 
tum system under an ideal Hamiltonian, i.e., assuming 
Hq is strongly regular and Hi is off-diagonal and fully 
connected. Without loss of generality we can also as- 
sume H Q £ su(n) , as the identity part of H only changes 
the global phase. Once the form of the Hamiltonian is 
fixed, the LaSalle invariant set E depends on the tar- 
get state p d only. We discuss in detail the two most 
important cases when (a) p d is a pseudo-pure state and 
hence dim(A / I) = 2n — 2, and when (b) p d is generic and 
dim(A / J) = n 2 — n, and conclude with a brief discussion 
of degenerate stationary target states p d . 



A. Pseudo-pure state control 

In this section we consider the special class of density 
operators acting on 7i = C™ whose spectrum consists of 
two eigenvalues {w, u} where u = (1 — w) j(n — 1) occurs 
with multiplicity n — 1 , which includes pure states with 
spectrum {1,0}. We first consider the special case of a 
two-level system as the results for this case can be easily 
visualized in 1R 3 and are useful in the general discussion 
of pure-state control problems for n-level systems that 
follows. 



1. Two-level systems 

For a two-lcvcl system strong regularity of Hq simply 
means that the energy levels are non-degenerate and full 
connectivity of Hi requires only &12 ^ 0, conditions that 
are satisfied in all but trivial cases. The density operator 
of a two-level system can be written as 

P = \ (co + xa x + y<T y + za z ) , (25) 



where s = (x, y, z) £ K 3 and the Pauli matrices are 





'1 0" 




'0 1" 




'0 -i 




'1 " 


O-Q = 


1 


, Ox = 


1 


,<Ty = 


i 


,cr z = 


-1 



Noting that Tr(p 2 ) = ±(1 + ||s|| 2 ) shows that in this 
representation pure states, characterized by Tr(p 2 ) = 1, 
correspond to points on the surface of the unit sphere 
S 2 G 1R 3 , while mixed states (Tr(p 2 ) < 1) correspond to 
points in the interior. The vector s is often called the 
Bloch vector of the quantum state. Any unitary evolu- 
tion of p(t) under a constant Hamiltonian corresponds to 
a rotation of s(t) about a fixed axis in 1R 3 , and free evo- 
lution under H = diag(ai, a 2 ) in particular corresponds 
to a rotation of the Bloch vector s(t) about the z-axis. 
Thus, in this special case the path s(t) traced out by any 
Bloch vector s evolving under any constant Hamiltonian 
forms a circle, i.e., a closed periodic orbit. 

Let s = (x,y,z) and Sd — {xd,yd, z d) be the Bloch 
vectors of p and pd, respectively. It is straightforward to 
show that [p, pd] diagonal implies 

zx d - xz d = 0, yz d - zy d = 0. (26) 

If (a) z d ^ then (x,y) = a(x d ,y d ) with a = z/z d , 
and thus x 2 + y 2 + z 2 = a 2 (x d + y d + z d ), and the RHS has 
to equal x d + y d + z d since = ||sd||. Thus a — ±1 and 
(x,y,z) — ±(xd,y dl Zd), and the corresponding density 
operators p,p d commute, [p,Pd] = 0. 

If (b) Zd = then either (bl) x d — and yd = 
or (b2) z = 0. In case (bl) we have s d = (0,0,0), i.e., 
the target state is the completely mixed state. Since the 
completely mixed state forms a trivial equivalence class 
under unitary evolution, the invariant set in this case 
is E = {(0,0)}. Case (b2) is more interesting with the 
invariant set being 

E = {(s,s d ) ■.z = z d = 0,x 2 + y 2 = x 2 +y 2 }, (27) 

i.e., all pairs of Bloch vectors that lie on a circle of ra- 
dius \\sd\\ in the equatorial plane. Notice that this set is 
significantly larger than the set of critical points of V, 
which consists only of {±s,j}. 

Hence, the invariant set E depends on the choice of the 
target state Sd(t). Ignoring the trivial case (bl), if Sd(t) 
is not in the equatorial plane 35j then the invariant set is 
equal to the set of critical points {±s ( j(t)} of V, and hence 
s(t) for a given initial state s(0) will converge to either 
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FIG. 1: Bloch sphere: There is a one-to-one correspondence 
between states p of a two-level quantum system and points 
inside the Bloch ball. Pure states correspond to points on the 
surface of the Bloch ball, mixed states to points in the interior. 
The Bloch vector of a pure state |*} = cosfljO) + e^sin6»|l) 
is s = (sin(2#) cos(<^)), sin(2#) sin <j>, cos(2#)). 



Sd(t) or its antipodal point —Sd(t). Furthermore, since 
V (s(t) , s d (t)) assumes its (global) maximum for s(t) = 
—Sd(t) and V is non-increasing, s(t) will converge to the 
target trajectory Sd(t) for all initial states s(0) 7^ —5^(0). 

If Sd(t) lies in the equatorial plane Zd — then 
the invariant set consists of all points (s(t),Sd(t)) with 
z(t) = z d (t) = and \\s(t)\\ = \\s d (t)\\, which lie on 
a circle of radius ||s*d(0)|| in the z — plane, and we 
can only say that any initial state s(0) E will con- 
verge to a trajectory si(t) with z\(t) = and ||si(t)|| = 
||sd(i)||. V{s\{t),Sd{t)) can take any limiting value be- 
tween Vmin = and V max = 2||sd(0)|| 2 in this case. No- 
tice that, although in almost all cases the trajectories 
s(t) and Sd(t) remain a fixed, non-zero distance apart 
for all times in this case, this result is consistent with 
the results in [55] for the weaker notion of orbit con- 
vergence, since the circle in the equatorial plane in this 
case corresponds to the orbit of Sd(t) under Hq, and any 
initial state converges to this set in the sense that the 
distance of s(t) to some point on this circle goes to zero 
for t — > 00. 



2. Pseudo-pure states for n > 2 

The density operator p for a pseudo-pure state in C™ 
with spectrum {w,u} can be written as 

p = ™n+— n 1 , o<w<i, (28) 

71 — 1 

where n is a rank-1 projector. Since n+n^ = /, we have 
= [x,IL + n- 1 ] for all x, and thus [x,^] = -[x,Il]. If 
Pd(0) is pseudo-pure, with pd(0) = wH + uHq, then for 
any (pi,p2) € E, p\ and P2 must also be pseudo-pure, 
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with the same spectrum {w,u}, i.e., p k = wll k + ull^ 
for k = 1,2. We have 

[ P x,P2]=w 2 [n 1 ,u 2 ] + uw[ui,n 2 ] 

+ uw[u 1 ,ui] + « 2 [n r ,n 2 L ] 
= w 2 p! , n 2 ] - 2uw p! , n 2 ] + u 2 pi , n 2 ] 
= ( w -u) 2 [n!,n 2 ]. (29) 

Thus the LaSalle invariant set contains all points such 
that M — [IIi,II 2 ] is diagonal. Since Ii k , k — 0, 1,2, are 
rank-1 projectors, life = |^E'fe)(^'fe|, where \^> k ) are unit 
vectors in C". Setting 



|f 1 ) = (a 1 e fal ,... ) a n e ia ») T 
|* 2 ) = (6 ie ^,...,& n e^) T 



(30) 



where \^ k ), k = 0,1,2, are pure states, represented as 
unit vectors in (D™ . We have 

m = pi,n 2 ] 

= |*l)(*l|*2>(* 2 | - |*2>(* 2 |*l>(*l| 

For (pi, p 2 ) € E, we require that all off-diagonal elements 
equal to zero, i.e.: 

M kl = a k b t e i ^-^{^ 1 \^ 2 ) - a t b k e l{0k ' at \^ 2 \^i). 

(31) 

for all k ^ I. Let (^>i\^> 2 ) = re 1 ® . We have the following 
two cases. 

(a) r = i.e ( v l'i| v l' 2 ) = or p\ _L p 2 . In this case, 
[pi,P2] = 0, and V(pi,p 2 ) = V max = (w - u) 2 . 

(b) If r ^ then Eq. Q together with M fcfc = leads 
to n(n— 1) /2 non-trivial equations for the population and 
phase coefficients, respectively: 



a-kbi = a e b k , 
p k +Pi = a k + a e + 29. 



(32) 
(33) 



If a k = then = a k bg = a^b k for £ ^ k and thus we 
must have b k = as at = for all ^ is not allowed as 
a is a unit vector. Ditto for b k — 0. Let I + be the set 
of all indices k so that a k ,b k ^ 0. Then the remaining 
non-trivial equations for the population coefficients can 
be rewritten 



Ofc 



(if 



Vft, £ e 1+ 



(34) 



and thus a — 76 and as a and 6 are unit vectors in IR" , 
7=1 and a = b. 

As for the phase equations ( 33 1 , if a k = b k = then 
My = is automatically satisfied, thus the only non- 
trivial equations are those for k,£ € I+. If the set J + 
contains rii > 2 indices then taking pairwise differences 
of the n\(ni — 1) /2 non-trivial phase equations and fixing 
the global phase of \^ k ) by setting a ni — (3 ni — shows 
that a = p. For example, suppose J+ = {1, 2, 3} then we 



have 3 non-trivial phase equations 

Pi +P 2 = ai + a 2 + 29, 
Pi +p 3 = ai + a 3 + 29, 
P 2 +p 3 = a 2 + a 3 + 29, 

taking pairwise differences gives 



P2- 03 = a 2 
Pi- 03 = cti 
Pi - P2 = cti 



«3, 

a 3 , 
a 2 , 



and setting a 3 = P 3 — shows that we must have a 2 = 
P 2 and a 3 — P 3 . Thus, together with a = b we have p\ = 
p 2 . If I + contains only a single element then \*f?i) and 
I $2) differ at most by a global phase and again pi = p 2 
follows. Incidentally, note that for |\E'i) = \^ 2 ) we have 
(tfi|tf 2 ) = 1, i.e., r= 1,6 = 0. 

The only exceptional case arises when I + contains ex- 
actly two elements, say {1, 2}, as in this case there is only 
a single phase equation Pi+ P 2 = «i + a 2 + 29, and thus 
even fixing the global phase by setting a 2 — p 2 — 0, only 
yields Pi — a>i = 29. This combined with a — b gives 



2„2i8 



and thus a 2 e 1 



= (*i|* 2 ) = afe 



? —iQ 

a 2 e = r or 



2i sin 9{a{ ~ a 2 ) = 0. 



Therefore, either 9 = or a\ = a 2 . If 6 = then a = 
and p\ = p 2 , which is one possible solution in the LaSalle 
invariant set. If 9 ^ 0, then any (pi, p 2 ) satisfying 



= 2- 1 / 2 (l,e ra ,0,. 
1*2) = 2- 1 / 2 (l,e^,0, . 



,0f 
,0f 



(35a) 
(35b) 



with P — a — 29 is also in the LaSalle invariant set 

Hence, if the target state is pd(0) = wUq 
IIo = l^oX^ol and \^o) has only two nonzero compo- 
nents with equal norm, e.g., if 



uHq with 



Pdifi) = 



( Tu r 12 (t) 
ri2(tY rn 
u 



\ 







(36) 



with rn = i(u> + u), ri 2 (t) = \(w - u)e la , and |W ) = 
2 1 / 2 (1, e lOL , 0, . . . , 0) T , then the invariant set contains all 
points (pi,p 2 ) satisfying (35 1, which includes p\ = p 2 
and pi _L p 2 . Since pi and p 2 lie on the orbit of Pd(0), 
any solution p(i) will converge to this orbit but we can- 
not guarantee p{t) — » Pd(t) as i ^ +00. This case is 
analoguous to the case where the target state was lo- 
cated in the equatorial plane of the Bloch ball for n = 2. 
For all other pd(0) the LaSalle invariant set contains only 
points with either p\ = p 2 or pi _L p 2 , corresponding to 
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V = and V — T4iax, respectively, and since V is non- 
increasing, any solution p(t) with V(p(0), Pd(Q)) < Knax 
will converge to as i — > +00. 

In summary we have the following result: 

Theorem V.l. Given a pseudo-pure state target state 
Pd(t) with spectrum {111,11} and 'ideal' Hamiltonians as 
defined, Lyapunov control is effective, i.e., any solution 
p(t) with V(p(0), Pd(0)) < Knax will converge to Pd(t) as 
t — > +00, except when pa has a single pair of non-zero 
off-diagonal entries of the form r^i{t) — \{vo — u)e la and 
Tkk — Til — \(w + u). In the latter case any solution p(t) 
will converge to the orbit of pd(t) but in general p(t) -/* 
Pd(t) ast —t +00 and V(p, pd) can take any limiting value 
between and Vjnax- 



B. Generic-state Control 

For generic states pd we shall distinguish between sta- 
tionary and non-stationary target states. Recall that 
Pd(t) is stationary if and only if [H o ,pd(0)] = 0. If H 
has non-zero eigenvalues, which is always the case if Ho 
is strongly regular, then this happens if and only if pd is 
diagonal in the eigenbasis of Hq. 



1. Generic stationary target state 



When pd is a stationary state Eq. (10) can be reduced 
to a dynamical system on M. 



p(t) = -i[H + f(p)H 1)P (t)] 
f(p) = Tr([-iH 1 ,p(t)]p d ) 

and the LaSalle invariant set can be reduced to 



E={ Po \V(p(t)) = 0,p(0)=p o } 
= {Po : [po,Pd] = diag(ci, ...,( 



.)} 



(37a) 
(37b) 



(38) 



according to Theorem |III.4 

If pd is generic and both pd and [p, pd] are diagonal 
then p must be diagonal and [p, p c i\ — since suppose 
Pd = diag(u>i, . . . , w n ) and p — (tv). Then the (k,£)-th 
component of [pd, p] is rui{wk — Wf). Since pd is generic 
=^ wi except for k = I and thus [pd,p] is diagonal 
only if rfe£ = for k 7^ £, i.e., if p is diagonal. Since 
the commutator of two diagonal matrices vanishes, the 
invariant set in this case reduces to the set of all po that 
commute with the stationary state pd, i.e., in this case 
the invariant set E not only contains the set of critical 
points F of the Lyapunov function but we have E = F. 
In summary we have: 

Theorem V.2. If pd is a generic stationary target state 
then the invariant set E contains exactly the n\ critical 
points of the Lyapunov function V, i.e., the stationary 
states p d , k = 1, . . . , nl, that commute with p^ and have 
the same spectrum. 



These critical points are the only stationary solutions 
and all the other solutions must converge to one of these 
points. However, we still cannot conclude that all or 
even most solutions converge to the target state pd- In 
fact we shall see that not all solutions p(t) converge to 
Pd even for p(0) ^ E. However, the target state pd is 
the only hyperbolic sink of the dynamical system, and 
all other critical points are hyperbolic saddles or sources, 
and therefore most (almost all) initial states will converge 
to the target state as desired. 

We note that Theorem |I V . 2| guarantees that for a given 
generic stationary state pd the critical points of the Lya- 
punov function V(p) are hyperbolic. Thus, if the dynam- 
ical system was the gradient flow of V(p) then asymptotic 
stability of these fixed points could be derived directly 
from the associated index number of the Morse func- 
tion I/|27j. However, since the dynamical system (37 1 



is not the gradient flow, further analysis of the lineariza- 
tion of the dynamics near the critical points is neces- 
sary. To this end we require a real representation for 
our complex dynamical system. A natural choice is the 
Bloch vector (sometimes also called Stokes tensor) rep- 
resentation, where a density operator p is represented 
as a vector s € 1R™ defined by — Tr(p£k), where 
£/j = —iak and {cfc} is the orthonormal basis of Su(N), as 
defined in the proof of Theorem IV. 2 The adjoint action 
Adin(p) — [iH,p] in this basis is given by a real anti- 
symmetric matrix A acting on s. Therefore, the quantum 
dynamical system ( 10 1 can be cquivalcntly represented as 



s(t) = (A + f&ZdWsit) 
Sd(t) = A s d (t) 
f(s,s d ) = Sd 7 Ais, 

where Aq — A-iH Q and A\ = . For a fixed station- 

ary target state pd this system can be reduced to 



At) = (A) + mA X )s{t) 



(40a) 

f(s) = sT A t s. (40b) 
The linearized system near the critical point s*o is 



s = D f(so) ■ (s- s ), 



(41) 



where Df(so) — Aq + AiSq ■ Sd A\ is a linear map defined 
on IT 2 - 1 . 

The state space Sm °f the real dynamical system is 

2 ~ i 

the set of all Bloch vectors s e IR n that correspond 
to density operators p e M. For generic states, M. is the 
complex flag manifold M. ~ Sil(n)/exp(C), where C is 
the Cartan subspace of the Lie algebra B\x(n). Hence, the 
tangent space Tvi(po) of M. at any point po corresponds 
to the non-Cartan subspace T of su(n) and the Cartan 
elements of su(n) correspond to the tangent space of the 
isotropy subgroup of po. In the equivalent real represen- 
tation M™ _1 is therefore the direct sum of the (n 2 — n)- 
dimensional tangent space St to the manifold Sm &ud 
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the (n— l)-dimensional subspace Sc corresponding to the 
Cartan subspace of su(n). 

Theorem V.3. For a generic stationary target state pd 
all the critical points of the dynamical system (31) are 



hyperbolic, pd is the only sink, all other critical points are 
saddles, except the global maximum, which is a source. 

Proof. We show that the critical points sq of the cor- 
responding real dynamical system (40) defined on Sm 



are hyperbolic. To this end, we first show that Df(so) 
vanishes on the (n — l)-dimensional subspace Sc, which 
is orthogonal to the tangent space of Sm- I n the sec- 
ond step we show that the restriction of Df(so) onto the 
tangent space of Sm is well-defined and has n 2 — n non- 
zero eigenvalues. Finally we show that the restriction of 
Df(so) onto the tangent space of Sm does not have any 
purely imaginary eigenvalues, from which it follows that 
s is a hyperbolic fixed point of the (real) dynamical sys- 
tem defined on Sm , and the local behavior of the original 
dynamical system can therefore be approximated by the 
linearized system [26 . 

Lemma V.l. Df(so) vanishes on the subspace Sc- 

Proof. To show that Df(so)s — for all s G Sq, it suf- 
fices to show that A s = and s^Ais = for s 6 Sc- 
s € Sc corresponds to density operators p G iC, i.e., p 
diagonal. As A$s is the Bloch vector associated with 
[— iH ,p], —iH is diagonal and since diagonal matri- 
ces commute, [— iHo,p] — and A$s = follows im- 
mediately. To establish the second part, we note that 
for ip G C and —iH\ G T, we have [—iH\,ip] G T, or 
[— iHi,p] G iT, and A\s G St- Since pd is diagonal and 
thus Sd G Sc -L St, we have s^Ais = for s G Sc- □ 

This lemma shows that sq is no t a hyperbolic fixed 



point of the dynamical system ( 40 ) defined on 1R 



However, we are only interested in the dynamics on the 
manifold Sm, an d thus it suffices to show that Sq is a 
hyperbolic fixed point of the restriction of D/(so) to the 
tangent space St of Sm ■ 

Lemma V.2. The restriction B of D/(so) to St is well- 
defined and has n 2 — n non-zero eigenvalues. 

Proof. Since we already know that Sc is in the kernel of 
Df(s ), it suffices to show that the image of D/(so) is 
contained in St, i.e., Df(so)s G St- To this end 

Df(s )s = A s + Ais a s^Axs 
= A s + (sd T Ais) AxSq 

shows that it suffices to show that Aos G St and 
AxSq G St- Both relations follow from the fact that the 
commutator of a Cartan element and a non-Cartan ele- 
ment of the Lie algebra su(n) is always in the non-Cartan 
algebra T, and thus [— iHo,p] G iT since — HIq G C, and 
[— iHi,pd] G iT since ipd G C. Therefore, the restriction 
B : St — > St of D/(sb)s is well defined. 



Furthermore, the restriction of Aq to St is a block- 
diagonal matrix Bq = diag(A ' c ' £ ' ) ) with 



A 



(M) 



1 
-1 



The restriction u of A\Sq to St is a column vector 
{vS 1,2 ); ?/ 1,3 ); . . . ; -ut"" 1 ^ 1 )) of length n(n — 1) consisting 
of n(n — l)/2 elementary parts 



V2 \nhi) 



(42) 



for k = 1, . . . , n — 1 and I = k + 1, . . . , n. Simi- 
larly, let v be the restriction of A\Sd to St- Then 
v = (rf 1 ^; . . .;v in - 1 ' n )) with t/( fc > £ ) as in Eq. Q and 
r the identity permutation. 

Thus the restriction of D/(s ) to the subspace St is 
B = Bq — uv T . Since u)m ^ for all k, I by regularity of 
H , we have det(Bo) = Ylk t w kt ^ ^ i- e -; A) invcrtible, 
and by the matrix determinant lemma |28j 

det(B) = det(B - uv T ) = (1 - v^B^u) det(B )- 

Bq 1 is a block-diagonal matrix with blocks 

Hence v f Bq 1 u = ^ k ^v^ k '^] T C^^u^^ vanishes since 

(9f(6 M ),»(6 w ) (^[^j) = 0, Vfc,£ 

Therefore, det(i3) = det(i?o) 7^ and thus the restriction 
of Df(so) to SV is invertible, and hence has only non-zero 
eigenvalues. □ 

Lemma V.3. Ififi is a purely imaginary eigenvalue of B 
then it must be an eigenvalue of B , i.e., i/3 — au>)-£ for 
some (k,t), and either the associated eigenvector e must 
be an eigenvector of Bq with the same eigenvalue, or the 
restriction of A\Sq to the (k,t) subspace must vanish. 

Proof. If 17 is not an eigenvalue of Bq then (Bo — i/3 1) is 
invertible and by the matrix determinant lemma 

= dct(B - uv T - i/3I) 
= det((B - i(3I) - uv T ) 
= (1 - v T (B - i/3I)- 1 u) det(B - i/3I). 

Since det(£?o — i(3I) 7^ we must therefore have 

v T (B Q -i/3I)- 1 u= 1. 

Noting that (Bq — i/31)^ 1 is block-diagonal with blocks 



C 



(k,i) 



-i/3 -lou 
lu m -iP 



(43) 



12 



for all k,£, this leads to 
1 = if (B - 01) 



El 

k,e 



-i/3 s-^ A fe ^A r ( fc)r (£) 



k,t 



J kl 



P 2 



>kl\ 



Since all terms in the sum are real this is a contradiction. 
Thus if i/3 is a purely imaginary eigenvalue of B then it 
must be an eigenvalue of Bq. 

Since the spectrum of Bo is {H^ki}j this means i/3 = 
±iu)ki for some (k,£). Without loss of generality assume 
7 = ^12 > and let e = x + iy be the associated eigen- 
vector of B. Then 



Be = (Bo — uv T )(x + iy) = iui\2(x + iy), 
which is equivalent to 

(B - uv T )x = -u>i 2 y 

(B - UV T )y = 0J\2X. 



(44) 

(45a) 
(45b) 



Multiplying (45 d) by — a7 12 -B 1 and adding it to (45 1) 
B a x 



uv x + loyiBq uv y = —uj 12 B q x 



Eq. ( 43 1 shows that 



B, 



(1,2) 



i.e., on the 



T\2 subspace the underlined terms above cancel, and thus 
the first two rows of the above system of equations are 



(v T x) 



(v T y). 



C 2 Ui 



If xfx ^ then the last equation gives U\ - 
and Ui = —c 2 U2 with c = ify/ifx, which can only be 
satisfied if ui = 112 = 0. Similarly if ify ^ 0. If v T x = 
ify = then we have Be = Boe = iwi2e, implying that 
e is an eigenvector of B associated with iu>i2- □ 

The previous lemma shows that B can have a purely 
imaginary eigenvalue i/3 only if i/3 = ±iu>ke for some 
(k,£), and either = 0, i.e., the projection of Ais 

onto the (k,£) subspace vanishes, or the associated eigen- 
vector is also an eigenvector of Bo- In the first case this 
means that AiSq vanishes on the subspace The, or equiv- 
alcntly that [—iHi,p ] has no support in 7^, which con- 
tradicts the assumption that H\ is fully connected and 
po has non-degenerate eigenvalues. On the other hand, if 
e is an eigenvector of Bo with eigenvalue i/3 = UtOkt and 
Hq is strongly regular then the projection of e onto the 
(k, £) subspace is proportional to (1, ±i) and e is zero else- 
where, and thus if e = implies v^ k '^ = 0, which con- 
tradicts the fact that the projection A\Sd or [— iHi,pd] 
onto the (k, £) subspace must not vanish if Hi is fully 
connected and pd has non-degenerate eigenvalues. Thus 
we can conlude that if Ho is strongly regular, Hi fully 
connected and pd has non-degenerate eigenvalues, Df(so) 
cannot have purely imaginary eigenvalues, and thus Sq is 
hyperbolic. □ 



From the previous theorem we know that all critical 
points po of V are in fact hyperbolic fixed points of the 
dynamical system. It is easy to see that among the n! 
fixed points, po — Pd, which corresponds to V(po) = 0, 
must be a sink, and the point corresponding to V(po) = 
V max must be a source. Any other fixed point po must 
be a saddle, with eigenvalues having both negative and 
positive real parts, for otherwise po would be a sink or 
source, and thus a local minimum or maximum of V, 
which would contradict Theorem IIV.2I Each of these 
saddle points has a stable manifold of dimension < n 2 — n, 
on which solutions p(t) will converge to the saddle point, 
but since the dimension is less than the dimension of the 
state manifold, these solutions only constitute a measure- 
zero set. Hence, for almost any flow p(t) outside E will 
converge to pd- In this sense, the Lyapunov control is 
still effective. 

Remark V.l. Since the critical points of the dynamical 
system (10) for a generic stationary state pd are hyper- 
bolic and they are also hyperbolic critical points of the 
function V(p) = V(p,pd), the dimension of the stable 
manifold at a critical point must be the same as the in- 
dex number of the critical point of the function V. 



2. Generic non-stationary target state 

For non-stationary states characterizating the invari- 
ant set is more complicated as E may now contain points 
with nonzero diagonal commutators. 

Example V.l. Let P2 = Pd(Q) an d consider 



Pi = 





1 


1 




ii 2 


I 12 






h 


12 


s 


24 



Pi = 



1 

3 
1 

12 

l_ 

12 



12 12 
1 _i 

4 3 



pi and P2 are isospectral and [pi,p 2 ] 
and thus (pi,P2) € E. 



^fdiag(0,l,-l) 



Simulations suggest that Lyapunov control is ineffec- 
tive, i.e., fails to steer p(t) to Pd(t) or even the orbit 
of Pd(t) in such cases. However, it is difficult to give 
a rigorous proof of this observation, as we lack a con- 
structive method to ascertain asymptotic stability near a 
non-stationary solution. In the special case where pd{t) 
is periodic there are tools such as Poincare maps but it 
is difficult to write down an explicit form of the Poincare 
map for general periodic orbits [29] . Moreover, as ob- 
served earlier, for n > 2 the orbits of non-stationary 
target states Pd(t) under Hq are periodic only in some 
exceptional cases. Fortunately though, we shall see that 
E = {[pi, P2] = 0} still holds for a very large class of 
generic target states Pd{t), and in these cases Lyapunov 
control tends to be effective. 



Noting [pi,p 2 ] = -Ad P2 (pi) 



where Ad P2 is a linear 



map from the Hcrmitian or anti-Hcrmitian matrices into 
su(n), let A(s 2 ) be the real (n 2 — 1) X (n 2 — 1) matrix cor- 
responding to the Stokes representation of Ad P2 . Recall 
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su(n) = T ®C and JR n 1 = S T © S c , where S c and S r 
are the real subspaces corresponding to the Cartan and 
non-Cartan subspaces, C and T, respectively. Let A(s 2 ) 
be the first n 2 — n rows of A(s 2 ) (whose image is St)- 

Lemma V.4. For a generic Pd{t) the invariant set E 
contains points with nonzero commutator if and only if 
rank A(sd(0)) < n 2 — n. 

Proof. It suffices to show that if rank A(sd) — n 2 — n, 
then for any p such that [p, Pd(0)] diagonal, we have 
[p,Pd(0)] = 0. If this is true then for any (pi,p%) G E 
with diagonal commutator, there exists some to such that 
p 2 = e lH ° to pd(0)e~ lH ° to and since [/?i,/»2] is diagonal, 
[e~ lH " to pie tHota , pd(0)] is also diagonal, hence equal to 
zero and [pi.,/92] = 0. 

Let p2 — Pd(0). First we show that the kernel of A(s 2 ) 
has dimension n — 1 and thus rank A(s 2 ) < n 2 ~ n. In 



this case rank A(sd) = 



rank J 4(s*2) implies that 



the remaining n — 1 rows of A(s*2) are linear combinations 
of the rows of A(sa) and therefore j4(s2)s*i = implies 
^(s*2)si = 0, or [pi,p 2 ] = 0. 

In order to show that the kernel of A(s 2 ) has dimen- 
sion n — 1, we recall that if p 2 = U diag(u>i, . . . , w n )U' 
for some U G 6il(n) then [pi,^] = for all p\ — 
L r diag(w r ( 1 ), . . . , w T ^ n \)U\ where r is a permutation of 
{1, . . . , n}. If the Wk > are distinct then these pi's span 
at least a subspace of dimension n since the determinant 
of the circulant matrix 



C = 



/ Wl 
w 2 



W n - 



U'2 
W n 



Wn- 



Wl 



W n -3 W n - 2 
W n -2 W n -lJ 



is non-zero, and hence its columns are linearly indepen- 
dent and span the n-dimensional subspace of diagonal 
matrices. If the Wk are distinct then the kernel cannot 
have dimension greater than n — 1 since the p\ can only 
span a subspace isomorphic to the set of diagonal matri- 
ces. Thus, the kernel of A(s 2 ) has dimension n — 1. (The 
dimension is reduced by one since we drop the projec- 
tion of p onto the identity in the Stokes representation.) 
Similarly, we can prove if rank A(sd(0)) < n 2 — n, then 
E contains points with nonzero commutator. □ 

This lemma provides a necessary and sufficient con- 
dition on pd(0) to ensure that [pi,/02] diagonal implies 
[pi)/?2] = 0. Assuming the first n 2 — n rows corre- 
spond to St, let Ai be the submatrix generated from 
the first n 2 — n rows and last n 2 — n columns of A(sd(0)). 
If det(-Ai) ^= then rank A(sd(0)) = n 2 — n, hence 
E = {[pi,p 2 ] = 0}. We can easily verify that if the 
diagonal elements of pd(0) are not equal then det(Ai) is 
a non-trivial polynomial, i.e., det(^4i) can only have a 
finite set of zeros. Hence we have: 



Theorem V.4. The invariant set E for a generic pd(t) 
contains points with nonzero commutator only if either 
Pd has some equal diagonal elements or det(Ai) = 0. 
Therefore, the set of pd(0) such that E contains points 
with nonzero commutator has measure zero with respect 
to the state space M . 

Hence, if we choose a generic target state pd(0) ran- 
domly, with probability one, it will be such that E — 
{[pi,p 2 ] — 0}. Simulations suggests Lyapuonv control is 
generally effective in this case, and we shall now prove 
this. Let Tfe for k — l,...,n! denote all the permuta- 
tions of the numbers {1, . . . , n} with t± being the identity 
permutation and r n i being the inversion. For any given 
density operator 



Pit) 



E 



\m)(m\ 



define the 'permutation' 



P [k \t) = E w Mm)\m){m\. 

m— 1 



(46) 



(47) 



Theorem V.5. If pd(t) is a generic state with invariant 
set E — {[pi,p 2 ] — 0} then any solution p(t) converges to 
p d k \t) for some k G {1, . . . , n\}, and all solutions except 
Pd\t) — Pd{t). which is stable, are unstable. 

Proof. For any solution (p(t),pd(t)) there exists a subse- 
quence {t m } such that (p(t m ),p d (t m )) -* [pupi) G E. 
If E only contains pairs (pi,p 2 ) that commute then we 
can choose an orthonormal basis such that both pi and 
p 2 are diagonal, and since p\ and p 2 have the same spec- 
trum, the diagonal elements of p\ must be a permutation 

(k) 

of those of p 2 , i.e., pi = p\ ' for some k. Thus we have 
p(t m ) -> pi = P ( 2 \ Pd{t m ) -* P2 and therefore 



p{t m ) -> P d (tm)- 



(48) 



If (p\,p 2 ) G E is a different positive limiting point of 
(p(t), pd(t)), we can similarly find a subsequence {t m i} 

such that p{t m i) — > Pd \t m i), for some k' . Since 
V (p(t) , pd(t)) is non-increasing along the trajectory, we 
must have k = k'. Therefore, the result (48 1 holds for 
any subsequence {t m }. 

To see that all solutions except those with pit) — > Pd(t) 
are unstable, we consider the dynamics in the interaction 
picture. Let 



P(t) = 



— & iH ot „ ,(i\ o -iH t _ 



Pd{t) = e lMot pd(t)e- iJlat = p d (0) 



x pd{t)e 



We have pd(t) — and the dynamical system becomes: 
p-(t) = f(t)[-iHi(t),p(t)] (49a) 



f(t) = Tr([-iHi(t),p(t)]pd) 



(49b) 
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where ffi(t) = e lH °*ifi(t)e 



-iH t 



and /(*) = /(*). Thus, 



the original autonomous dynamical system (p(i), Pd{t)), 
where pd is not stationary, has transformed into a non- 
autonomous system, where pd is a fixed point. According 



to Theorems V.2 and V.3 for a given pd there are n\ hy- 
perbolic critical points of the function V(p) — V(p,pd), 

denoted by p d , k — 1, . ..,n!, with p d ^ = pd and p d 
corresponding to the minimum and maximum, respec- 
tively. They are also the fixed points of the dynamical 



system (49 1 



If E = {[pi, P2] — 0} then any solution p(t) must con- 
verge one of the critical points p d . Since the fixed points 
of the dynamical system ( |49[ ) coincide with the n! hy- 
perbolic critical points of V(p) for a given pd and V is 
non-increasing along any solution, it is easy to see that 
pd and p d correspond to a stable and unstable point, 

respectively. For any other fixed point p d k \ if it is sta- 
ble, it must be asymptotically stable since all solutions 
must converge to one of these fixed points. However, by 
the continuity of the function V, this would imply that 
p d is a local minimum, which is a contradiction to the 
fact that it is a hyperbolic saddle of V(p). Therefore, all 
the 'i nte rmediate' fixed points are unstable for the sys- 
tem (49 1, and therefore p d k \t), k = 2, . . . , n\ — 1, must 
be unstable. □ 



but has degenerate eigenvalues then there may be large 
critical manifolds but we can still derive a result simi- 
lar to the asymptotic stability of pd in the discussion of 
generic stationary states pd- 

Theorem V.7. If pd is a stationary state with degener- 
ate eigenvalues then p = p d is a hyperbolic critical point 
of the function V(p) = V(p, pd) and it is isolated from 
the other critical points. 

Proof. Choose a basis such that pd is diagonal, 



p d = diag(ai, ...,01,02,. . 



, a fe ,...,afc), (50) 



and let ni,n2, ... ,rik, denote the multiplicities of the dis- 
tinct eigenvalues, where n £ = n - Using the same 
notation as in Theorem |IV.2| p = pd achieves the maxi- 
mal value of J = Tr(ppd) = Tr(C7 pdU^ pd). To show that 
it is a hyperbolic maximum of J (hence minimum of V) 
we need to find n' independent directions along each of 
which J is a local maximum, where n' is the dimension 



of the manifold M. , in our case n' 



2 "Ef=i^- A s in 
the proof of Theorem |IV.2| we note that for the curves 
with x • (7 — Xket and x ■ a — Xkgt, the conjugate action 
of Afe£ or X k e on the critical point p = Pd swaps the k-th 
and £-th diagonal elements. Hence the number of swaps 
that decrease the value of J is 



Numerical simulations for non-stationary target states 
Pd{t) such that E = {[pi,pz] = 0} suggest that almost 
all solutions p(t) converge to pd, which is consistent with 
the theorem. However, unlike for the stationary case we 
cannot conclude that the solutions converging to the sad- 
dles between the maximum and minimum constitute a 
measure-zero set. We can still show, though, that in 
principle there exist solutions p{t) starting very close to 

Pd(t) that converge to the target state pd- So the region 
of asymptotic stability of Pd(t) is at least not confined to 
a local neighborhood of it. 



Theorem V.6. In the interaction picture (4-9) for any 
saddle point p d k °^ with 1 < ko < n\ not all solutions p(t) 
with V(p(0)) > V(p d ko) ) can converge to it. 

Proof. From the topological structure near a hyperbolic 
saddle point we know that the pre-image of V — V{p d k °^) 
contains not only p d k °^. Therefore, we can choose a po 



such that V(po) = V(p d ko) ) and p Q ^ p [ d °>. Since the 
solution pit) with p(0) = pa cannot be a stationary, there 
exists a time t x < such that V{p(ti)) > V(p d k ° } ). □ 



(feo) 



C. Other stationary target states 

We have shown that for 'ideal' systems, Lyapunov con- 
trol is mostly effective for both pseudo-pure and generic 
states, which covers the largest and most important 
classes of states. Finally, we show that if pd is stationary 



e=2 



e=3 



2(ni rij + ri2 ^ nt -\ h n k - X n k 

1 

k 



nj = n! . 



Therefore, p = pd is a hyperbolic point of J, hence of V . 
Since the critical values of V as shown in Eq. (24 1, are iso- 
lated and pd is the unique minimal value, it must also be 
isolated from the other critical points, which completes 
the proof. □ 

Furthermore, we can show that pd is also a hyperbolic 
fixed point for the dynamical system ( 37 1 : 



Theorem V.8. // pd is a stationary state with degen- 
erate eigenvalues then p — pd is a hyperbolic sink of the 
dynamical system \3 r i 



Proof. As in Theorem V.3 we need to analyze the eigen- 
values of linearization matrix Df(sd). In order to show 
Sd is hyperbolic, it suffices to show that there are tim 
eigenvalues with nonzero real parts, corresponding to n» 
eigenvectors in the tangent space of M. at Sd, denoted as 
Tjvtisd)- Let v be acolumn vector consisting of n(n— 1)/2 
elementary parts: 



t(M) _ 



A« (%(b ke ] 
V2 W«) 



(51) 



and let B = B a — vir be the restriction of Df(s d ) to 
the subspace St as before. Following a similar argument 
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as in Lemma V.3 it is easy to see that for (k,£) such 
that Ak£ = 0, the eigenelement (uike, ?ke) of Bq is also an 
eigenelement of B as tre^ — 0, and that corresponds 
to a direction orthogonal to the tangent space Tm(s<j). 
The number of such (k,£) is 



N 



By same arguments as in the proof of Theorem |V.3| it 
therefore is easy to show that the remaining eigenvalues 
of B with eigenvectors corresponding to the directions in 
Tm (sd) must have non-zero real parts. A simple counting 
argument shows that the number of these eigenvalues is 
2(2) — n — dim(A4) and thus pd is a hyperbolic point. 
Since pa achieves the minimum of V, these eigenvalues 
must have negative real parts, i.e., pd must be a sink. □ 

Hence, any solution p(t) near pd will converge to pd for 
t — > +00, which establishes local asymptotic stability of 
Pd- The next question is whether this asymptotic conver- 
gence holds for a larger domain, as in the case of station- 
ary non-degenerate pd- In order to answer this, we need 
to investigate the LaSalle invariant set. For a stationary 
Pd with degenerate eigenvalues as in Eq. (50 1 there are 
P = ni i-L k < distinct diagonal p satisfying^ , Pd] = 0. 
First of all, we have the following lemma: 

Lemma V.5. Any stationary point po other than pd 
must correspond to a maximum along some direction. 

Proof. Since p 7^ pd, we have V(po) > V(pd), and anal- 
ogous to the proof in Theorem |IV.2[ there exists some 
swap Xki such that po corresponds to a maximum along 
that direction. □ 

Furthermore, we can prove that the LaSalle invariant 
set consists of centre manifolds with the diagonal station- 
ary states po as centres. This can be easily illustrated 
with the following example: 

Example V.2. For a three-level system with pd — 
diag(|, |, |), the dimension of the state manifold M. is 
dim M = 3 2 — 2 2 — 1 = 4 and the LaSalle invariant set 
E contains all points po of the form 



Po 



'an ai2 

d*2 a 22 

a 33 , 



with eigenvalues {|, 7, i}. 1/033 — \ then we have po — 
Pd, which is an isolated hyperbolic sink. All other po 
in E satisfy 033 = | and form a manifold A4q, which 
contains two stationary states pi — diag (|, |, ^) o,nd 
P2 = diag (i, i j J that commute with pd- 

Analogous to the proof of Theorem \ V.8\ we can ana- 
lyze the linearization of the dynamical system near one 
of the critical point pi, I — 1,2. It is easy to see that 
the two tangent vectors of the centre manifold at pi ( cor- 
responding to two purely imaginary eigenvalues) are also 



the tangent vectors of the invariant manifold M.$. There- 
fore, Mq is the centre manifold. The other two eigenval- 
ues must have positive real parts, since pi is the maximal 
point of V. This analysis is also true for p2- Hence, 
except for the target state pd, the points in the LaSalle 
invariant set form a centre manifold with the stationary 
points pi, I = 1,2 as centres. 

In general, we can analyze the linearization near any 
of the p — 1 stationary points of the dynamical 

system. For a stationary point po other than pd, analysis 
the eigenvalues of the linearized system, analogous to the 
previous example, shows that the purely imaginary eigen- 
values correspond to the centre manifolds generated by 
the LaSalle invariant set, where po is a centre on the cen- 
tre manifold. Other eigenvalues can be similarly proved 
to have either positive or negative real parts. Moreover, 
the spectrum must contain eigenvalues with positive real 
parts; otherwise, po would be dynamically stable, cor- 
responding to a local minimum of V, which contradicts 
Lemma |V.5| Hence, near p , except for the solutions on 
the stable manifold of po, all the other solutions will move 
away. Therefore, globally, provided we start outside the 
LaSalle invariant set, most solutions will converge to pd, 
similar to the results for generic stationary pd- 



VI. CONVERGENCE OF LYAPUNOV 
CONTROL FOR REALISTIC SYSTEMS 

In the previous section we studied the invariant set and 
convergence behavior of Lyapunov control for systems 
that satisfy very strong requirements, namely complete 
regularity of Hq and complete connectedness of the tran- 
sition graph associated with Hi. We shall now consider 
how the invariant set and convergence properties change 
when the system requirements are relaxed. Without loss 
of generality, we present the analysis for a qutrit sys- 
tem noting that the generalization to n-lcvcl systems is 
straightforward . 



A. Hi not fully connected 

Suppose Hq is strongly regular but Hi does not have 
couplings between every two energy levels, i.e., the field 
does not drive every possible transition, as is typically the 
case in practice. For example, for many model systems 
such as the Morse oscillator only transitions between ad- 
jacent energy levels are permitted and we have for n = 3: 



'a x 
H = I a 2 

a 3 . 



Hi 



h 
bl b 2 
b* 



where we may assume a\ < 02 < a 3l for instance. 

According to the characterization of the invariant set E 
derived in Section III a necessary condition for (pi,p2) 
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to be in the invariant set E is that [pi,p2] is orthog- 
onal to the subspace spanned by the sequence B = 
span{£? m }^ =0 with B rn = Ad^™^ o (— ii^). Comparison 
with ( 15 1 shows that if the coefficient b^i = then none 
of the generators B m have support in the root space 
of the Lie algebra, and it is easy to see that the sub- 
space of su(n) generated by B is the direct sum of all 
root spaces Tki with bke =/= 0. 

Thus, in our example, a necessary condition for (pi, p^) 
to be in the invariant set E is p 2 ] S T13 © C, which 
shows that [pi,p2] must be of the form 



we know the tangent space of the centre manifold, if we 
can find an invariant manifold that has this tangent space 
at s c i, then it is a centre manifold. 

In our case solutions in the invariant set E form a 
manifold that is diffcomorphic to the Bloch sphere for a 
qubit system, with the natural mapping embedding 
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Furthermore, if (p!,p 2 ) is of type (52) then 
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with Uo = e lHot and u>m = at — Q-k, also has the form. 
Therefore, [pi, p 2 ] eCffi 7i 3 is a necessary and sufficient 
condition for the invariant set E. 

If pd is diagonal with non-degenerate eigenvalues then 
E consists of all (pi, p 2 ) with p 2 = pd and pi of the form 



Pi 
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(54) 



Thus, the invariant set E contains a finite number of 
isolated fixed points corresponding to 0i3 — 0, which 
coincide with the critical points of V(p, pd) as a func- 



(55) 

which maps the state pd (or Sd) of the qutrit to the 
point s' d on the Bloch sphere corresponding to p' d — 
diag(wi, W3)/(wi + W3), and the two tangent vectors of 
the centre manifold at pd to the two tangent vectors of the 
Bloch sphere at s^. Thus this manifold is the required 
centre manifold at pd (or sj). On the centre manifold 
Pd is a centre with the nearby solutions cycling around 
it. The Hartman-Grobman theorem in centre manifold 
theory proved by Carr [3U] shows that all solutions out- 
side E converge exponentially to solutions on the centre 
manifold belonging to Sd, while the solutions actually 
converging to Sd only constitute a set of measure zero. 
Therefore, when Hi is not fully connected, the trajecto- 
ries p(t) for most initial states p(0) will not converge to 
the target state pd (or another critical point of V) but to 
other trajectories pi (t) C E, which are not in orbit of pd 
either. 



B. Ho not strongly regular 

Next let us consider systems with Hi fully connected 
but Hq not strongly regular, such as 
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We check the stability of linearized system near these 
fixed points, concentrating on the local behavior near Sd- 
Working with a real representation of the linearized sys- 



tem (41 1 and using the same notation as before, we can 
still show that Df(sd) has n 2 — n nonzero eigenvalues, n 
equal to three in our case. Since — iHi has no support in 
the root space 7i3, the A13 and A13 components of AiSd, 
(which correspond to [— iHi, pd]) vanish, and Df(sd) has 
a pair of purely imaginary eigenvalues whose eigenspaces 
span the root space T13 and four eigenvalues with non- 
zero real parts, which must be negative since Sd is lo- 
cally stable from the Lyapunov construction. However, 
the existence of two purely imaginary eigenvalues means 
that the target state is no longer a hyperbolic fixed point 
but there is centre manifold of dimension two. From the 
centre manifold theory, the qualitative behavior near the 
fixed point is determined by the qualitative behavior of 
the flows on the centre manifold [30] . Therefore, the next 
step is to determine the centre manifold. For dimensions 
greater than two, this is generally a hard problem if we 
do not know the solution of the system. However, since 



(56) 



i.e., UJ12 = LO23 = lo. In order to determine the subspace 
spanned by B = {B m }^ =0 [See ( [T5|], w e note that the 
characteristic Vandermonde matrix (|18|) of the system 

'I LO 2 LO A 

to,.,\4 



V = 1 (2w) 2 (2w) 4 



1 



0J 



has rank two as only the first two rows are linearly 
independent. We find that in this case the invariant 
set E is characterized by [p, pd] S C © span{^, p} with 
P- = Ai 2 — A 2 3, fi — X12 — A 23 . 





[p,Pd] = I /3i* 2 A i2 
^/3i 3 A 23 



-/3i 2 A 12 -/3 13 A 23 ■ 
-/32 3 A 23 
/3 2 * 3 A23 



where A^ = Wk — wg. Thus [p, pd) G C span{/j,, p} im- 
plies P13 — and A2A12 = — /323A23. So all p e E form 
a two-dimensional manifold with coordinates determined 
by the A12 and A12 components of p. 
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As we are interested in the local dynamics near the 
target state, we again study the linearization at the fixed 
point pd for the case of a generic stationary state, i.e., 
Pd diagonal with non-degenerate eigenvalues. Using the 
same notation as before, the matrix Bq, i.e., the restric- 
tion of Ad-iH to the subspace St, has six non-zero 
eigenvalues {±zw, ±2io>}, where ±iuj occurs with multi- 
plicity two, and since det(B) = det(£?o), we know that B 
also has six non-zero eigenvalues. However, two of these 
are purely imaginary, namely ±ico, as it can easily be 
checked that det(P> ± iwl) = 0, and the corresponding 
vectors are 

e ±lu = (-A,T*A,0,0,l,-i) T 

where A = A23/A12. Moreover, we know that all other 
eigenvalues of B must have negative (non-zero) real parts. 
Analogous to the last subsection, we can show that the 
invariant set E forms a centre manifold near Sd with Sd 
as a centre. Thus by the Hartman-Grobman theorem of 
the centre manifold theory, we can again infer that most 
of the solutions near Sd will not converge to Sd- 

VII. CONCLUSIONS AND FURTHER 
DISCUSSIONS 

We have presented a detailed analysis of the Lyapunov 
method for the problem of steering a quantum system to- 
wards a stationary target state, or tracking the trajectory 
of a non-stationary target state under free evolution, for 
finite-dimensional quantum systems governed by a bilin- 
ear control Hamiltonian. Although our results are par- 
tially consistent with previously published work in the 
area, our analysis suggests a more complicated picture 
than previously described. 

First, to allow proper application of the LaSalle invari- 
ance principle we transform the original control problem 
into an autonomous dynamical systems defined on an 
extended state space. Characterization of the LaSalle 
invariant set for this system shows that it always con- 
tains the full set of critical points F of the distance-like 
Lyapunov function V(p\,p2) = — P2W 2 defined on 

the extended state space A4 x M., where M. is the ap- 
propriate flag manifold for the density operators p\,pi- 
Consistent with previous work we show that the criti- 
cal points of V are the only points in the invariant set 
for ideal systems, i.e., systems with strongly regular drift 
Hamiltonian Ha and fully connected control Hamiltonian 
Hi, and stationary target states pd- However, we also 
show that the invariant set is larger for non-stationary 
target states or non-ideal systems, the main difference 
being that for ideal systems, there is only a measure-zero 
set of target states for which the invariant set E is larger 
than F, while for non-ideal systems the invariant set is 
always significantly larger than F. This observation is 
important because numerical simulations sugggest that 
Lyapunov control design is mostly effective if the invari- 
ant set is limited to the critical points of V, but likely 



to fail otherwise. Our analysis for various cases explains 
why. 

For a generic target state (stationary or not) there is 
always a finite set of nl critical points of V, and it can 
be shown using stability analysis that all of these critical 
points, except the target state, are unstable. Specifically, 
for a stationary generic target state we can show that all 
the critical points are hyperbolic critical points of V and 
hyperbolic critical points of the dynamical system, with 
the target state being the only hyperbolic sink. All the 
other critical points are hyperbolic saddles, except for 
one hyperbolic source corresponding to the global maxi- 
mum. Although this picture is somewhat similar to that 
presented in [22] . our dynamical systems analysis shows 
the other critical points, referred to as antipodal points 
in |22j . are unstable, but except for the global maximum, 
not repulsive. In fact, all the hyperbolic saddles have 
stable manifolds of positive dimension. Thus, the set of 
initial states that do not converge to the target state, 
even in this ideal case, is larger than the (finite) set of 
antipodal points itself, although for ideal systems and 
generic stationary target states, it is a measure-zero set 
of the state space. For stationary states with degenerate 
eigenvalues (non-generic states) the set of critical points 
is much larger, forming a collection of multiple critical 
manifolds. However, for ideal systems we can show that 
even in this case the target state is the still the only 
hyperbolic sink of the dynamical system and asymptoti- 
cally stable. Thus, in general we can still conclude that 
most states will converge to the target state, although it 
is non-trivial to show that the set of states that converge 
to points on the other critical manifolds has measure zero, 
except for the class of pseudo-pure states. This class is 
special since the set of critial points in this case has only 
two components: a single isolated point corresponding to 
the global minimum of V, which is a hyperbolic sink of 
the dynamical system, and a critical manifold homeomor- 
phic to CP™~ 2 for M = CP™ -1 , on which V assumes its 
global maximum value V m & x . Thus, although the points 
comprising the critical manifold are not repulsive, since 
V is decreasing as function of t, no initial states outside 
this manifold can converge to it. We note that this ar- 
gument was employed in |22j to argue that the critical 
points other than the target state are 'repulsive' but our 
analysis shows that it works only for the class of pseudo- 
pure states. 

Thus, although our analysis suggest that, e.g., that 
there are initial states other than the antipodal points 
that will not converge to the target state even for ideal 
systems, the set of states for which the Lyapunov control 
fails is small, except for a measure-zero set of target states 
for which the invariant set contains non-critical points. 
For ideal system one could therefore conclude that the 
Lyapunov method is overall an effective control strategy. 
However, most physical systems are not ideal, and the 
Hamiltonians Hq and Hi are unlikely to satisfy the very 
stringent conditions of strong regularity and full connect- 
edness, respectively. For instance, these assumptions rule 
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out all systems with nearest-neighbour coupling only, as 
well as any system with equally spaced or degenerate en- 
ergy levels, despite the fact that most of these systems 
can be shown to be completely controllable as bilinear 
Hamiltonian control systems. In fact, the requirements 
for complete controllability are very low. Any system 
with strongly regular drift Hamiltonian H , whose tran- 
sition graph is not disconnected, for instance, is control- 
lable |31j . and in many cases even much weaker require- 
ments suffice [32, 33 . In practice, a bilinear Hamiltonian 
system can generally fail to be controllable only if it is 
decomposable into non-interacting subsystems or has cer- 
tain (Lie group) symmetries, ensuring that, e.g., the dy- 
namics is restricted to a subgroup such as the symplectic 
group [3"1] . 

Unfortunately, our analysis shows that the picture 
changes drastically for non-ideal systems, with the 
target state ceasing to be a hyperbolic sink of the 
dynamical system and becoming a centre on a centre 
manifold contained in a significantly enlarged invariant 
set E. Using results from centre manifold theory, we 
must conclude that most of the solutions pit) converge 
to solutions on the centre manifold other than the 
target state pd- This result casts serious doubts on 
the effectiveness of the Lyapunov method for realistic 
systems, in fact, it strongly suggests that Lyapunov 
control design is an effective method only for a very 
small subset of controllable quantum systems. These 
results appear to be in conflict with some recently 
published results on Lyapunov control, which suggest 
that when the Hamiltonian and target state satisfy a 
certain algebraic condition then any state p(0) that 
is not an 'antipodal' point of pd(0) asymptotically 
converges to the orbit of the target state pd(t) [55] , and 
claims that the 'antipodal' points are repulsive. Since 



the notion of orbit convergence that was used in [55] is 
weaker than the notion of convergence in the sence of 
trajectory tracking we have used, one might conjecture 
this to be the source of the discrepancy, and since 
orbit tracking may be quite adequate for many control 
problems that do not require precise phase control, for 
instance, this could mean that Lyapunov control might 
still be an effective control strategy for many quantum 
control problems. However, this does not appear to be 
the case here. For instance, the notions of orbit and 
trajectory tracking are identical for stationary target 
states but even for ideal systems and stationary generic 
target states that satisfy the conditions in [52], our 
analysis suggests that the antipodal points, except one 
global maximum, are hyperbolic saddle points and hence 
unstable but not repulsive. Furthermore, careful analysis 
of our results shows that for ideal systems convergence 
of p(t) to the orbit of pdif) implies p(t) — > pd(t) except 
for a measure-zero set of target states Pd(t). 
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